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(54) Image display system and method 

(57) A method of displaying an image (1 2) with a dis- 
play device (28) including a plurality of display pixels 
(70) includes receiving image data (16) for the image, 
the image data including Individual pixels (1 B) of the im- 
age; buffering the image data and creating a frame (28) 
of the image, the frame of the image including a plurality 
of columns and a plurality of rows of the pixels of the 
image; defining a first suWrame (301) and at least a 
second sub-frame (302) for the frame of the image, im- 



age data of the second sub-frame being offset from im- 
age data of the first sub-frame by an offset distance of 
at least one pixel; and displayingthe first sub-frame with 
a first plurality of th© display pixels and displaying the 
second sub-frame with a second plurality of the display 
pixels offset from the first plurality of the display pixels 
by the offset distance. 
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Description 

Cross-Reference tD Related Applications 

[0001] This application is a Continuetlon-ln-Part of s 
copending U.S, Patty* Application Serial No. 
10/21 3,555, filed on August 7, 2002, assigned to the as- 
signee of the present invention, and Incorporated herein 
by reference. This application Is related to U.S. Patent 

Application Serial No. , filed on 10 

, having attorney docket number 

1 001 1 0563, assigned to the assignee of the present in- 
vention, and incorporated herein by reference. 

The Reld of the Invention 

[0002] The present invention relates generally to im- 
aging systems, and more particularly to a system and 
method of displaying an image. 

Background of the Invention 

[0003] A conventional system or device for displaying 
an image, such as a display, projector, or other imaging 
system, produces a displayed image by addressing an 
array of individual picture elements or pixels arranged 
in horizontal rows and vertical columns. Unfortunately, 
if one or more of the pixels of the display device is de- 
fective, the displayed image will replicate the defect. For 
example, if a pixel of the display device exhibits only an 
"ON" position, the pixel may produce a solid white 
square in the displayed image. In addition, if a pixel of 
the display device exhibits only an "OFF" position, the 
pixel may produce a solid black square in the displayed 
Image. Thus, the affect of the defective pixel or pixels of 
the display device may be readily visible in the displayed 
image. 

Summary of the Invention 

[0004] One aspect of the present invention provides 
a method of displaying an image with a display device 
including a plurality of display pixels. The method in- 
cludes receiving image data for the image, the image 
data including individual pixels of the image; buffering 
the image data and creating a frame of the image, the 
frame of the image including a plurality of columns and 
a plurality of rows of the pixels of the image; defining a 
first sub^frame and at least a second sub-frame for the 
frame of the image, (mage data of the second sub-frame 
being offset from image data of the first sub-frame by 
art offset distance of at least one pixel; and displaying 
the first sub-frame with a first plurality of the display pix- 
els and displaying the second sub-frame with a second 
plurality of the display pixels offset from thefirst plurality 
cf the display pixels by the offset distance. 



Brief Description of the Drawings 

[0005] Figure 1 is a block diagram illustrating one em- 
bodiment of an image display system. 
[0006] Figures 2A-2C are schematic illustrations of 
one embodiment of processing and displaying a frame 
of an image according to the present invention. 
[0007] Figures 3A-3C are schematic illustrations of 
one embodiment of displaying a pixel with an Image dis- 
play system according to the present Invention. 
[0008] Figure A Is a simulation of one embodiment of 
an enlarged image portion produced without processing 
by an image display system according to the present 
invention, 

[0009] Figure 5 is a simulation of one embodiment of 
an enlarged image portion produced with processing by 
an image display system according to the present in- 
vention. 

[001O] Figures 6A-BE are schematic illustrations of 
another embodiment of processing and displaying a 
frame of an Image according to the present invention. 
10011] Figures 7A-7E are schematic illustrations of 
one embodiment of displaying a pixel with an image dis- 
play system according to the present invention. 
[0012] FTgure8isasimulationofanotherembodiment 
of an enlarged image portion produced without process- 
ing by an image display system according to the present 
invention. 

[001 31 Figure 9 is asimulation of another embodiment 
of an enlarged image portion produced with processing 
by an Image display system according to the present 
Invention. 

[001 4] Figure 1 0 is a schematic illustration of one em- 
bodiment of display pixels of a display device according 
to the present invention. 

p 01 5] Figure 1 1 is a schematic illustration of one em- 
bodiment of image data for an image frame according 
to the present invention. 

[0016] Figures 12A-1 2D are schematic illustrations of 
one embodiment of image sub-frames for the image 
frame of Figure 11. 

[00171 Figures 1 3A-1 3D are schematic Illustrations of 
one embodiment of displayed image portions for the im- 
age frame. of Figure 11 produced with me image sub- 
frames of Figures 12A-12D. 
[0018] Figures 14A-14D are schematic Illustrations of 
one embodiment of display of the displayed image por- 
tions of Figures 13A-13D. 

[0019] Figure 14E is a schematic illustration of one 
embodiment of shifting the displayed image portions of 
Figures 14A-14D, 

[0020] Figure 1 5 is a schematic illustration of one em- 
bodiment of display of the Image data for the image 
frame of Figure 1 1 with an image display system accord- 
ing to the present invention. 

[0021] Figure 16 is a schematic illustration of another 
embodiment of shifting displayed image portions for a 
displayed image produced with an image display sys- 
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tem according to the present Invention. 
IP022] Figure 1 7 is a schematic illustration of another 
embodiment of shifting displayed image portions for a 
displayed image produced with an image display sys- 
tem according to the present invention. 
[0023] Figure 1 8 is a schematic Illustration of another 
embodiment of shifting displayed image portions for a 
displayed image produced with an image display sys- 
tem according to the present invention. 
[00241 Figure 1 a is a schematic Illustration of another 
embodiment of shifting displayed image portions for a 
displayed image produced with an image display sys- 
tem according to the present invention. 
[0025} Figure 20 Is a schematic illustration of another 
embodiment of shifting displayed image portions for a 
displayed image produced with an image display sys- 
tem according to the present invention. 
[0026J Figure 21 is a schematio illustration of another 
embodiment of shifting displayed Image portions for a 
displayed image produced with an image display sys- 
tem according to the present invention. 
10027] Figure 22 is a simulation of one embodiment 
of an enlarged image portion produced without process- 
ing by an image display system according to the present 
invention. 

[0028] Figure 23 is a simulation of one embodiment 
of an enlarged image portion produced with processing 
by an image display system including resolution en- 
hancement and error hiding according to the present in- 
vention. 

Description of the Preferred Embodiments 

[0029] In the following detailed description of the pre- 
ferred embodiments, reference Is made to the accom- 
panying drawings which form a part hereof, and in which 
is shown by way of illustration specific embodiments in 
which the invention may be practiced. It is to be under- 
stood that other embodiments may be utilized and struc- 
tural or logical changes may be made without departing 
from the scope of the present invention. The following 
detailed description, therefore, is not to be taken in a 
limiting sense, and the scope of the present invention is 
defined by the appended claims. 
[0030] Figure 1 illustrates one embodiment of an im- 
age display system 10. imagB display system 10 facili- 
tates processing of an image 12 to create a displayed 
image 14. Image 12 is defined to include any pictorial, 
graphical, and/or textural characters, symbols, illustra- 
tions, and/or other representation of information. Image 
1 2 is represented, for example, by image data 1 6. Image 
data 16 includes individual picture elements or pixels of 
image 1 2. While one image is Illustrated and described 
as being processed by Image display system 10, it is 
understood that a plurality or series of images may be 
processed and displayed by image display system 1 0. 
[0031] In one embodiment, image display system 1 0 
includes a frame rate conversion unit 20 and an image 



4 

frame buffer 22, an image processing unit 24, and a dis- 
play device 26. As described below, frame rate conver- 
sionunit20and image frame buffer 22 receive and buff- 
er image data 1 6 for image 1 2 to create an image frame 
28 for Image 12. In addition, image processing unit 24 
processes image frame 26 to define one or more image 
sub-frames 30 for image frame 28, and display device 
26 temporally and spatially displays image sub-frames 
30 to produce displayed image 14. 
[0 032] frnage display system 1 0, Including frame rate 
conversion unit 20 and/or image processing unit 24. in- 
cludes hardware, software, firmware, or a combination 
of these. In one embodiment, one or more components 
of image display system 10, including frame rate con- 
version unit 20 artd/br image processing unit 24, are in- 
cluded In a computer, computer server, or other micro- 
processor-based system capable of performing a se- 
quence of logic operations. In addition* processing can 
be distributed throughoutthesystem with Individual por- 
tions being Implemented in separate system compo- 
nents, 

[Q033] Image data 1 8 may include digital image data 
1 61 or analog image data 1 62. To process analog image 
data 1 62. Image display system 10 includes an analog- 
to-digital (A/D) converter 32. As such. A/D converter 32 
converts analog image data 1 62 to digital form for sub- 
sequent processing. Thus, image display system 10 
may receive and process digital image data 161 and/or 
analog image data 162 for image 12. 
[0034] Frame rate conversion unit 20 receives image 
data 16 for image 12 and buffers or stores image data 
16 in image frame buffer 22. More specifically, frame 
rate conversion unit 20 receives image data 16 repre- 
senting individual fines or fields of image 12 and buffers 
Image data 16 in image frame buffer 22 to create image 
frame 28 for image 12. Imago frame buffer 22 buffers 
image data 16 by receiving and storing all of the image 
data for image frame 28 and frame rate conversion unit 
20 creates image frame 28 by subsequently retrieving 
or extracting all of the Image data for image frame 28 
from image frame buffer 22. As such,* image frame 28 
is defined to include a plurality of individual lines orfields 
of image data 16 representing an entirety of image 12. 
Thus, image frame 28 includes e plurality of columns 
and a plurality of rows of individual pixels representing 
imagS 12. 

[0035] Frame rate conversion unit 20 and image 
frame buffer 22 can receive and process image data 1 6 
as progressive image data and/or interlaced image da- 
ta- With progressive Image data, frame rate conversion 
unit 20 and image frame buffer 22 receive and store se- 
quential fields of image data 16 for image 12. Thus, 
frame rate conversion unit 20 creates image frame 28 
by retrieving the sequential fields of image data 16 for 
Image 12. With interlaced Image data, frame rate con- 
version unit 20 and image frame buffer 22 receive and 
store odd fields and even fields of image data 1 6 for im- 
age 1 2. For example, all of the odd fields of image data 
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16 are received and stored and all of the even fields of 
Image data 1 6 are received and stored. As such, frame 
rate conversion unit 20 de-interlaces Image data 1 6 and 
creates image frame 28 by retrieving the odd and even 
fields of image data 1 6 for image 1 2. 
[0036] Image frame buffer 22 Includes memory for 
storing image data 1 8 for one or more image frames 28 
of respective images 12. Thus. Image frame buffer 22 
constitutes a database of one or more image frames 28. 
Examples of Image frame buffer 22 include non-volatile 
memory (e.g„ a hard disk drive or other persistent stor- 
age device) and may include volatile memory (e.g., ran- 
dom access memory (RAM)). 
[0037] By receiving image data 1 6 at frame rate con- 
version unit 20 and buffering image data 1 6 with Image 
frame buffer 22, Input timing of image data 16 can be 
decoupled from a timing requirement of display device 
26. More specifically, since Image data 16 for image 
frame 28 is received and stored by image frame buffer 
22, image data 1 6 can be received as input at any rate. 
As such, the frame rate of image frame 23 can be con- 
verted to the timing requirement of display device 26. 
Thus, image data 1 6 for image frame 23 can be extract- 
ed from image frame buffer 22 at a frame rate of display 
device 26. 

[0038] In one embodiment, image processing unit 24 
includes a resolution adjustment unit 34 and a sub- 
frame generation unit 36. As described below, resolution 
adjustment unit 34 receives image data 16 for image 
frame 28 and adjusts a resolution of image data 16 for 
display on display device 26, and sub-frame generation 
unit 36 generates a plurality of image sub-frames 30 for 
image frame 2B. More specifically, image processing 
unit 24 receives image data 1 6 for image frame 28 at an 
original resolution and processes image data 16 to 
match the resolution of display device 26. For example, 
Image processing unit 24 increases, decreases, and/or 
leaves unaltered the resolution of Image data 16 so as 
to match the resolution of display device 26. Thus, by 
matching the resolution of image data IS to the resolu- 
tion of display device 26, display device 26 can display 
image data 16. Accordingly, with Image processing unit 
24, image display system 10 can receive and display 
Image data 16 of varying resolutions. 
[0039] In one embodiment, image processing unit 24 
increases a resolution of image data 16. For example, 
image data 1 6 may be of a resolution less than that of 
display device 26. More specifically, image data 16 may 
include lower resolution data, such as 400 pixels by 300 
pixels, and display device 26 may support higher reso- 
lution data, such as 800 pixels by 600 pixels. As such, 
image processing unit 24 processes image data 16 to 
increase the resolution of image data 1 6 to the resolu- 
tion of display device 26. Image processing unit 24 may 
increase the resolution of Image data 1 6 by, for example, 
pixel replication, interpolation, and/or any other resolu- 
tion synthesis or generation technique. 
[0040] m one embodiment, image processing unit 24 



decreases a resolution of image data 16. For example, 
image data 16 may be of a resolution greater than that 
of display device 26. More specifically, image data 16 
may include higher resolution data, such as 1 600 pixels 
by 1 200 pixels, and display device 26 may support lower 
resolution data, such as 800 pixels by 600 pixels. As 
such, image processing unit 24 processes image data 
16 to decrease the resolution of image data 16 to the 
resolution of display device 26. Image processing unit 
24 may decrease the resolution of image data 16 by, for 
example, sub-sampling, interpolation, and/or any other 
resolution reduction technique. 
[0041] Sub-frame generation unit 36 receives and 
processes image data 1 6 for image frame 28 to define 
a plurality of image sub-frames 30 for image frame 28. 
If resolution adjustment unit 34 has adjusted the reso- 
lution of image data 16, sub-frame generation unit 36 
receives image data 1 6 at the adjusted resolution. The 
adjusted resolution of image data 1 6 may be increased, 
decreased, or the same as the original resolution of im- 
age data 1 6 for image frame 28. Sub-frame generation 
unit 36 generates image sub-frames 30 with a resolution 
which matches the resolution of display device 26. Im- 
age sub-frames 30 are each of an area equal to image 
frame 28 and each include a plurality of columns and a 
plurality of rows of individual pixels representing a sub- 
set of image data 1 6 of Image 12 and have a resolution 
which matches the resolution of display device 26. 
[0042] Each image sub-frame 30 Includes a matrix or 
array of pixels for image frame 28. Image sub-frames 
30 are spatially offset from each other such that each 
image sub-frame 30 includes different pixels and/or por- 
tions of pixels. As such, image sub-frames 30 are offset 
from each other by a vertical distance and/or a horizon- 
tal distance, as described below. 
[0043] Display device 26 receives image sub-frames 
30 from image processing unit 24 and sequentially dis- 
plays image sub-frames 30 to create displayed image 
14. More specifically, as image sub-frames 30 are spa- 
tially offset from each other, display device 26 displays 
image sub-frames 30 In different positions according to 
the spatial offset of image sub-frames 30, as described 
below. As such, display device 26 alternates between 
displaying image sub-frames 30 for Image frame 28 to 
create displayed image 14. Accordingly, display device 
26 dlspfays an entire sub-frame 30 for Image frame 28 
at one time. 

[0044] in one embodiment, display device 26 com- 
pletes one cycle of displaying image sub-frames 30 for 
imageframe28. Thus, display device 26 displays Image 
sub-frames 30 so as to b© spatially and temporally offset 
from each other. In one embodiment, display device 26 
optically steers image sub-frames 30 to create dis- 
played image 14. As such, individual pixels of display 
device 26 are addressed to multiple locations. 
[0045] In one embodiment, display device 26 includes 
an Image shffter 38. Image shifter 38 spatially alters or 
offsets the position of image sub-frames 30 as displayed 
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by display device 26. More specifically, image shifter3B 
varies the position of display of image sub-frames 30, 
as described below, to produce displayed image 14. 
[0046] in one embodiment, display device 26 includes 
a light modulator for modulation of incident light The 
light modulator includes, for example. a plurality of mi- 
cro-mirror devices arranged to form an array of micro- 
mirror devices. As such, each micro-mirror device con- 
stitutes one cell or pixel of display device 26. Display 
device 26 may form part of a display, projector, or other 
• imaging system. 

[0047] In one embodiment, image display system 1 0 
includes a timing generator 40. Timing generator 40 
communicates, for example, wtttr frame rat© conversion 
unit 20, image processing unit 24, including resolution 
adjustment unft 34 and sub^rame generation unit 33, 
and display device 26, including image shifter 38. As 
such, timing generator 40 synchronizes buffering and 
conversion of image data 1 $ to create image frame 28, 
or oceesin g of Image frame 28 to adjust the resolution of 
image data 1 Q to the resolution of display device 26 and 
generate image sub-frames 30, and display and posi- 
tioning of Image sub-frames 30 to produce displayed im- 
age 14. Accordingly, timing generator40 controls timing 
of image display system 1 0 such thai entire sub-frames 
of Imago 12 are temporally and spatially displayed by 
display device 26 as displayed Image 14. 

Resolution Enhancement 

[0048] In one embodime nt. as illustrated in Figures 2A 
and 2B, image processing unit 24 defines a plurality of 
Image sub-frames 30 for image frame 23. More specif- 
ically, image processing unit 24 defines afirst sub-frame 
301 and a second sub-frame 302 for image frame 28. 
As such, first sub-frame 301 and second sub-frame 302 
each include a plurality of columns and a plurality of 
rows of Individual pixels 1 8 of image data 1,6. Thus, first 
sub-frame 301 and second sub-frame 302 each consti- 
tute an image data array or pixel matrix of a subset of 
image data 16. 

[0049] In one embodiment, as illustrated In Figure 2B, 
second sub-frame 302 is offset from first sub-frame 301 
by a vertical distance 50 and a horizontal distance 52. 
As such, second sub-frame 302 is spatially offset from 
first sub-frame 301 by a predetermined distance. In one 
Illustrative embodiment, vertical distance 50 and hori- 
zontal distance 52 are each approximately one-half of 
one pixel. 

[0050] As illustrated In Figure 2C, display device 26 
alternates between displaying first sub-frame 301 in a 
first position and displaying second sub-frame 302 in a 
second position spatially offset from the first position. 
More specifically, display device 2 5 shifts display of sec- 
ond sub-frame 302 relative to display of first sub-frame 
301 by vertical distance 50 and horizontal distance 52. 
As such, pixels of first sub-frame 301 overlap pixels of 
second sub-frame 302. In one embodiment, display de- 
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vice 25 completes one cycle of displaying first sub-frame 

301 in the first position and displaying second sub-frame 

302 in the second position for image frame 28. Thus, 
second sub-frame 302 is spatially and temporally dis- 

5 played relative to first sub-frame 301 . 

[Q051] Figures 3A-3C illustrate one embodiment of 
completing one cycle of displaying a pixel 1 81 from first 
sub-frame 301 in the first position and displaying a pixel 
1 82 from second sub-frame 302 in the second position. 

10 More specifically, Figure 3A illustrates display of pixel 
181 from first sub-frame 301 in the first position, Figure 
3B illustrates display of pixel 1B2 from second sub- 
frame 302 in the second position (with the first position 
being illustrated by dashed linea), and Figure 3C illus- 

1 s trates display of pixel 1 81 from first sub-frame 301 in the 
first position (with the second position being illustrated 
by dashed Lines). 

[0052] Figures 4 and 5 illustrate enlarged image por- 
tions produced from the same image data without and 

so with, respectively, image processing by image display 
system 1 0. More specifically, Figure 4 illustrates an en- 
larged image portion 60 produced without processing 
by image display system 10, As Illustrated in Figure 4, 
enlarged image portion 60 appears pfacelated wrffi indl- 

25 vidua! pixels being readily visible. In addition! enlarged 
image portion 60 is of a lower resolution. 
[0053] Figure 5, however, illustrates an enlarged im- 
age portion 62 produced with processing by image Dis- 
play system 10, As illustrated in Figure 5, enlarged im- 

£0 age portion 62 does not appear as pixelated as enlarged 
image portion $0 of Figure 4. Thus, image quality of en- 
larged image portion 62 id enhanced with image display 
system 1 0. More specifically, resolution of enlarged im- 
age portion 62 Is Improved or increased compared to 
enlarged frnage portion 60. 

[0054] In one illustrative embodiment enlarged im- 
age portion 62 Is produced by two-position processing 
including a first sub-frame and a second sub-frame, as 
described above. Thus, twice the amount of pixel data 

ad is used to create enlarged image portion 62 as com- 
pared to the amount of pixel data used to create en- 
larged image portion 60, Accordingly, with two-position 
processing, the resolution of enlarged image portion 62 
Is Increased relative to the resolution of enlarged image 

4s portion 60 by a factor of approximately 1 .4 or the square 
root of two. 

[0055] In another embod»n©nt, as illustrated in Fig- 
ures 6A-6D, image processing unit 24 defines a plurality 
of image sub-frames 30 tor image frame 23, More spe- 

so cifically, Image processing unit 24 defines a first sub- 
frame 301 , a second sub-frame 302, a third sub-frame 
303. and a fourth sub-frame 304 fo r image frame 28. As 
such, first sur>frame 301 , second sub-frame 302, third 
sub-frame 303, and fourth sub-frame 304 each include 

55 aplurality of columns and a plurality of rows of individual 
pixels 1 8 of Image data 16. 

[0056] In one embodiment, as Illustrated in Figure 6B- 
6D, second sub-frame 302 is offset from first sub-frame 
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301 by a vertical distance SO and a horizontal distance 
52, third sub-frame 303 Is offset from first sub-frame 301 
by a horizontal distance 54, and fourth sub-frame 304 
Is offset from first sub-frame 301 by a vertical distance 
56. As such, second sub-frame 302, third sub-frame 
303, and fourth sub-frame 304 are each spatially offset 
from each other and spatially offset from first sub-frame 
301 by a predetermined distance. In one illustrative em- 
bodiment, vertical distance 50, horizontal distance 52, 
horizontal distance 54, and vertical distance 58 are each 
approximately one-half of one pixel. 
[0057J As illustrated schematically in Figure 6E, dis- 
play device 26 alternates between displaying first sub- 
frame 301 in a first position P 1( displaying second sub- 
frame 302 in a second positfon P 2 spatially offset from 
thofirstpositSon, displaying third sub-frame 303 inathlrd 
position P s spatlallyoffsetfromthefirst position, anddis- 
playing fourth sub-frame 304 In a fourth position P 4 spa- 
tially offset from the first position. More specifically, die- 
play device 26 shifts dispfay of second sub-frame 302, 
third sub-frame 303, and fourth sub-frame 304 relatrve- 
to first sub-frame 301 by the respective predetermined 
distance. As such, pixels of first sub-fram e 301 1 second 
sub-frame 302, third sub-framo 303, and fourth sub- 
frame 304 overlap each other. 
[0058] In one embodiment, display device 25 com- 
pletes one cycle of displaying first sub-frame 301 in the 
first positron, displaying second sub-frame 302 in the 
second position, displaying third sub-frame 303 in the 
third position , and displaying fourth sub-frame 304 in the 
fourth position for image frame 28. Thus, second sub- 
frame 302, third sub-frame 303, and fourth sub-frame 
304 are spatially and temporally displayed relative to 
each other and relative to first sub-frame 301 . 
[0059] Figures 7A-7E illustrate one embodiment of 
completing one cycle of displaying a pixel 1 81 from first 
sub-frame301 in the first position, displaying a pixel 1 82 
from second sub-frame 302 in the second position, dis- 
playing a pixel 1 83 from third sub-f«xtme ^03 in the third 
position, and displaying a pixel 184 from fourth sub- 
frame 304 in the fourth position. More specifically, Fig- 
ure 7A illustrates display of pixel 181 from first sub- 
frame 301 in the first position. Figure 7B illustrates dis- 
play of pixel 1 82 from second sub-frame 302 in the sec- 
ond position (with the first position being illustrated by 
dashed lines), Figure 7C illustrates display of pixel 183 
from third sub-frame 303 in the third position {with the 
first position and the second position being illustrated 
by dashed lines), Figure 7D illustrates display of pixel 
184 from fourth sub-frame 304 in the fourth position 
(with the first position, the second position, and the third 
position being illustrated by dashed lines), and Figure 
7E illustrates display of pixel 181 from first sub-frame 
301 in the first position (with the second position, the 
third position, and the fourth position being illustrated by 
dashed lines). 

[0060] Figures 8 and 9 illustrate enlarged image por- 
tions produced from the same image data without and 



with, respectively, Image processing by image display 
system 1 0. More specifically, Figure 8 Illustrates an en- 
larged image portion 64 produced without processing 
by image display system 10. As illustrated in Figure 8, 
5 areas of enlarged image portion 64 appear pixeteted 
with individual pixels including, forexample, pixels form- 
ing and/or outlining letters of enlarged image portion 84 
being readily visible. 

[0061] Figure 9. however, illustrates an enlarged Im- 

10 age portion 68 produced with processing by Image dis- 
play system 10. As illustrated in Figure 9, enlarged im- 
age portion 68 does not appear pixelated compared to 
enlarged image portion 64 of Figure 8, Thus, image 
quality of enlarged image portion 66 is enhanced with 

15 image display system 10. More specifically, resolution 
of enlarged image portion 66 is improved or increased 
compared to enlarged image portion 64. 
[0062] In one illustrative embodiment, enlarged im- 
age portion 66 is produced by four-position processing 

20 including a first sub-frame, a second sub-frame, a third 
sub-frame, and a fourth sub-frame, as described above. 
Thus, four times the amount of pixel data is used to cre- 
ate enlarged image portion 66 as compared to the 
amount of pixel data used to create enlarged image por- 

25 tion 64. Accordingly, with four-position processing, the 
resolution of enlarged image portion 64 is Increased rel- 
ative to the resolution of enlarged image portion 64 by 
a factor of two or the square root of four. Four-position 
processing, therefore, allows image data 16 to be dis- 

30 played at double the resolution of display device 26 
since double the number of pixels in each axis (x and y) 
gives four times as many pixels. 
[0063] By defining a plurality of imago sub^ramee 30 
for image frame 28 and spatially and temporally display- 

35 ing image sub-frames 30 relative to each other, Image 
display system 1 0 can produce displayed image 1 4 with 
a resolution greater than that of display device 29. In 
one illustrative embodiment, for example, with image 
data 16 having a resolution of 800 pixels by 600 pixels 

4a and display device 26 having a resolution of 800 pixels 
by 600 pixels, four-position processing by image display 
system 10 with resolution adjustment of image data 1 6 
produces displayed image 14 with a resolution of 1600 
pixels by 1200 pixels. Accordingly, with lower resolution 

AS image data and a lower resolution display device, image 
display system 10 can produce a higher resolution dis- 
played image. In another illustrative embodiment, forex- 
ample, with image data 16 having a resolution of 1600 
pixels by 1200 pixels and display device 26 having a 

so resolution of 800 pixels by 600 pixels, four-position 
processing by image display system 1 0 without resolu- 
tion adjustment of Image data 16 produces displayed 
image 14 with a resolution of 1600 pixels by 1200 pixels. 
Accordingly, with higher resolution image data and a 

55 lower resolution display device, image display system 
10 can produce a higher resolution displayed image. In 
addition, by overlapping pixels of image sub-frames 30 
while spatially and temporally displaying image sub- 
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frames 30 relative to each other, image display system 
10 can reduce the •screen-door" effect caused, for ex- 
ample, by gaps between adjacent micro-mirror devices 
of a light modulator. 

[0064] By buffering Image data "16 to create image 
frame 28 and decouple a timing of image data 16 from 
a frame rate of display device 26 and displaying an en- 
tiresub-f fame 30 (or image f ram© 28 at once, image dis- 
play system 10 can produce displayed image 14 with 
improved resolution over the entire image. Jn addition, 
with image data of a resolution equal to or greater than 
a resolution of display device 26, image display system 
10 can produce displayed image 14 with an increased 
resolution grearerthan that of display device 26. To pro- 
duce displayed image 14 with a resolution greater than 
that of display device 26, higher resolution data can be 
supplied to Image display system 10 as original image 
data or synthesized by image display system 10 from 
the original image data. Alternatively, tower resolution 
data can be supplied to Image display system 1 0 and 
used to produce displayed image 14 with a resolution 
greater than that of display device 26. Use of lower res- 
olution data allows for sending of images at a lower data 
rate while stBI allowing for higher resolution display of 
the data. Thus, use of a lower data rate may enable low- 
er speed data Interfaces and result In potentially less 
EMI radiation. 

Error Hiding 

[0065] In one embodiment, as Illustrated in Figure 1 0, 
display device 26 includes a plurality of columns and a 
plurality of rows of display pixels 70. Display pixels 70 
modulate light to display image sub-frames 30 for image 
frame 28 and produce displayed Image 1 4. Each display 
pixel 70 may include all three color parts, namely, red, 
green, and blue. In that case > each display pfcel 70 of 
display device 26 is capable of producing a full gamut 
of colors for display. 

[0066] In one Illustrative embodiment! display device 
26 includes a 6x6 array of display pixels 70. Display pix- 
els 70 are identified, for example, by row (A-F>and col- 
umn (1-6). While display device 26 is illustrated as in- 
cluding a 6x6 array of display pixels, it is understood that 
the actual number of display pixels 70 in display device 
26 may vary. 

[0067] In one embodiment, one or more display pixels 
70 of display device 26 may be defective. In one em- 
bodiment, display pixel 70 in location Q3 is a defective 
display pixel 72, A defective display pixel is defined to 
Include an aberrant or inoperative display pixel of dis- 
play device 26 such as a display pixel which exhibits 
only an "ON" or an "OFF position, a display pixel which 
produces less intensity or more intensity than intended, 
and/or a display pixel with inconsistent or random oper- 
ation. 

tOOaa] In one embodiment, image display system 1 0 
diffuses the affect of a defective display pixel or pixels 



NO. 460 P. 14 



18 839A2 12 

of display device 26. As described below, image display 
system 1 0 diffuses the affect of a defective display pixel 
or pixels by separating or dispersing areas of displayed 
image 14 which are produced by a defective display pix- 

s el Of display device 26. 

[0069] Figure 1 1 illustrates one embodiment of Image 
frame 28 for image 1 2. As described above, image data 
16 for image 12 Is buffered to create Image frame 28 
such that image frame 28 includes a plurality of columns 

10 and a plurality of rows of individual pixels 1 B of image 
data 1 6. In one ill ustrative embodiment image frame 28 
includes a 4x4 array of pixels 1 8. Pixels 1 8 of image data 
1 6 are identified, for example, by roman numerals l-XVL 
[0070] In one embodiment, as illustrated In Figures 

1$ 12A-12D, image processing unit 24 defines a plurality 
of image sub-frames 30* (Figure 1) for image frame 28. 
More specifically, image processing unit 24 defines a 
first image sub-frame 30V, a second image sub-frame 
302*, a third image sub-frame 303', and a fourth image 

2o sub-frame 304' for image frame 28. First image sub- 
frame 30V, second image sub4rame 302*, third image 
sub-framB 303', and fourth Image sub-frame 304', each 
include image data 16 for image frame 28 and, In one 
embodiment, are each of an area equal to that of display 

as device 26. As such, a top left of each image sub-frame 
80* Is indexed or mapped to display pixel A1 Of display 
device 26 (Figure 1 0). as described below. 
[0071] In one embodiment, image data 16 is of an ar- 
ea less than that of display device 26- As such, image 

so data 16 can be shifted among display pixels 70 of dis- 
play device 26 to diffuse the affect of a defective display 
pixel, as described below. Thus, display pixels 70 out- 
side of image data 1 6 are identified ad blank display pix- 
els 74 (Figure 13A). 

& [0072] In one embodiment, Image processing unit 24 
scales image data 1 6 so as to be of a size less than that 
of display device 26. In one embotfment, display device 
26 is of a size greater than a standard size of image data 
16. For example, in one illustrative embodiment, display 

to device 26 has a size of 602 pixels by 802 pixels so as 
to accommodate Image data 16 of a standard size of 
600 pixels by 800 pixels. 

0)073] In one embodiment, as illustrated in Figures 
12B-12D, image data 16 of second image sub-frame 

45 302' is offsetf rem image data 1 6 of first image sub-frame 
30V by horizontal distance 52, image data 16 of third 
image sub-frame 303' is offset from Image data 16 of 
second image sub-frame 302* by vertical distance 50, 
and Image data 16 of fourth image sub-frame 304' is 

50 offset from image data 16 of third image sub-frame 303* 
by horizontal distance 54. As such, image data 1 6 of first 
Bnage sub-frame 30V, image data 16 of second Image 
sub-frame 302', image data 16 of third image sub-frame 
303', and image data 16 of fourth image sub-frame 304', 

5$ are spatially offset from each other by a predetermined 
distance. In one embodiment, the predetermined dis- 
tance includes n pixels, wherein n is a whole number. In 
one illustrative embodiment, as illustrated in Figures 
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12B-12D, horizontal distance 52, vertical distance SO, 
and horizontal distance 54 are each one pixel. 
[0074] In one embodiment, as illustrated In Figures 
13A-13D, display device 26 alternates between displays 
ing first image sub-frame 301 ', second image sub-frame 
302', third image sub-frame 303', and fourth Image sub- 
frame 304' fcr image frame 28. In one embodiment, first 
image sub-frame 301 \ second image sub-frame 302\ 
third image sub-frame 303'. and fourth image sub-frame 
304', are each displayed with display device 28 such 
that the top left of each image sub-frame 30" rs mapped 
to display pixel A1 of display device 26. However, with 
image data 1 6 being ofteet In each of second image sub- 
frame 302\ third image sub^rame 303', and fourth Im- 
age sub-frame 304' relative to first image sub-frame 
301 ', different display pixels 70 of display device 26 dis- 
play image data 16 forfiret image sub-frame 30V, sec- 
ond image sub-frame 302\ third image sub-frame 303', 
and fourth image sub-frame 304'. 
[00751 For example, as illustrated in Figure 13A, dis- 
play pixels B2-E5 display image data 16 of first image 
sub-frame 301 ' as a displayed image portion 1 41 . How- 
ever, sfnce display pixel 70 in location C3 is a defective 
display pixel, pixel VI of image data 1 6 as displayed for 
first image sub-frame 30V of image frame 28 is defec- 
tive. 

[0076] As illustrated in Figure 13B, display pixels 
B1-E4 display image data 16 for second image sub- 
frame 302" as a displayed Image portion 142. However, 
since display pixel 70 In location C3 is a defective die- 
play pixel, pixel VII of image data 16 as displayed for 
second image sub-frame 302* of image frame 28 is de- 
fective. 

[0077] As Illustrated in Figure 13C, display pixels 
A1-D4 display image data 16 forthird image sub-frame 
303' as a displayed image portion 143. However, since 
display pixel 70 in location 03 is a defective display pix- 
el, pixel XI of image data 1 6 as displayed for third image 
sub-frame 303* of image frame 28 is defective. 
[0078] As illustrated in Figure 1SD, display pixels 
A2-D5 display image data 1 6 forfourth Image sub-frame 
304' as a displayed image portion 144. However, since 
display pixel 70 in location C3 Is a defective display pix- 
el, pixel X of Image data 1 6 as displayed forfourth image 
sub-frame 304' of image frame 28 is defective. 
[0079] In one embodiment, as illustrated in Figures 
14A-14D, display device 26 displays displayed image 
portions 141 , 142, 143, and 144 in the same display po- 
sition. More specifically, display device 26 shifts display 
of displayed image portions 142, 143, and 144 SO as to 
coincide with the display of displayed image portion 141 
in display positions ai-div. As such, display device 26 
displays all displayed image portions 141 , 1 42, 143, and 
144 In display positions ai-div. 
[0080] Since pixel VI of displayed image portion 141 
is created with a defective display pixel , the pixel for dis- 
play position bii i3 defective for displayed image portion 
141 . In addition since pixel VII of displayed image por- 
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tlon 1 42 is created with a defective display pixel, the pix- 
el for display position biii is defectivefor displayed image 
portion 142. In addition, since pixel XI of displayed im- 
age portion 1 43 is created with a defective display pixel, 

5 the pixel for display position cili is defective for displayed 
image portion 143.- Furthermore, since pixel X of dis- 
played image portion 1 44 Is created with a defective dis- 
play pixel, the pixel for display position cii is defective 
for displayed image portion 144. 

jo [ogsi] In one embodiment, as illustrated In Figure 
14E, displayed image portions 141 , 142, 143, and 144 
produced from image sub-frames 30V, 302* , 303", and 
304', respectively, are shifted according to tfie offset dis- 
tance of the respective Image sub-frames 30*. Morespe- 

is crfically, displayed image portions 142,143, and 144 are 
each shifted in a direction opposite the direction by 
which image data 16 of image sub-frames 302', 303', 
and 304', respectively, are offset relative to each other, 
[0082] For example, in one embodiment, image data 

so 16 of image sub-frame 302' is shifted to the left (as il- 
lustrated in Figure 12B) relative to image data 1 6 of im- 
age sub-frame 301\ As such, displayed image portion 
142 is.shifted to the right from position A to position B. 
In addition, image data 16 of image sub-frame 303' is 

2* shifted up (as Illustrated in Figure 120) relative to Image 
data 16 of image sub-frame 302\ As such, displayed 
Image portion 143 is shifted down from position B to po- 
sition C. Furthermore, image data 16 of image sub- 
frame 304' is shifted to the right (as Illustrated in Figure 

so 1 2D) relative to image data 1 6 of Image sub-frame 303'. 
As such, displayed image portion 144 Is shifted to the 
left from position C to position D. Thus, pixels 1-XVI of 
image data 1 6 for each image sub-frame 30" of image 
frame 28 of image 1 2 are displayed in the same display 

35 positions, namely, display positions ai-div, as illustrated 
in Figures 14A-14D. 

[0083] In one embodiment, image shifter 38 (Figure 
1) of display device 26 shifts display of image sub- 
frames 30* as described above. Moreepecincally, image 

4C shifter38 shifts display of second imagesub^frame 302* , 
third image sub-frame 303\ and fourth image sub-frame 
304' to the display position of first image sub-frame 30 1 ' 
so as to align displayed image portions 142, 143, and 
1 44 with displayed image portion 1 41 . Thus, image data 

43 within image sub-frames 30' Is property aligned. 

[0084] As illustrated in Figure 15, displayed image 
portions 141, 1 42, 143, and 1 44 each contribute to dis- 
played image 1 4. As such, pixels l-XVl of Image data 1 6 
for each imagesub-frame 301 ', 302', 303', and 304' con- 

so tribute to display positions al-dlv. Thus, each display po- 
sition ai-div displays the corresponding pixels of image 
data 16. For example, display position al displays pixel 
\ of image data 1 6 for image sub-frames 301 \ 302*. 303', 
and 304', as represented by Ia+'b+'c^'d' U re P~ 

33 resents pixel I of image data 16 for image sub-frame 
30V, I B represents pixel I of image data 16 for image 
sub-frame 302", l c represents pixel I of image data 16 
for image sub-frame 303\ and l D represent pixel I of 
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image data 1 6 for image dub-frame 304'. 
[0085] Since display pixel 70 in location C3 is a de- 
fective display pixel, pixel VI of image data 1 6 for first 
Image sub-frame 301 1 is defective, pixel VII of image da- 
ta 1 6 for $econd image sub-frame 302* is defective, pixel 
XI of image data 16 for third Image sub-frame 303* is 
defective, and pixel X of image data 1 6 for fourth image 
sub-frame 304' is defective (Figure© 1 4A-1 4D). As such, 
display position bii is represented by D A +Vl B 4.Vlc+Vl D , 
display position bril Is represented by VI^+DgWII^Vl- 
I Dj display position ciii is represented by 
X| A+ Xl0+Oc+XI D , and display position cii is represented 
by X a +Xb +x c+°d> where D Af Db, D c , and D D represent 
defective pixels from first Image sub-frame 301 \ second 
image sub-frame 302\ third image sub-frame 303', and 
fourth image sub-frame 304', respectively. Thus, defec- 
tive display pixel 72 in location CS of display device 26 
contributes to one of four pixels for each pixel of dis- 
played image 1 4 in display positions bll, bfli, ciii, and cii. 
Accordingly, rn one embodiment, the contribution of a 
defective display pixel to a pixel of the displayed Image 
Is distributed or diffused so as to be equal to 1/D, where 
D is the number of display pixels touched by the defec- 
tive display pixeL 

[0036] Since pixels of displayed image 1 4 in each of 
the display positions ai-drv are produced by four inde- 
pendent display pixels 70 of display device 26 ffor ex- 
ample, Ia+Ib+'c^d)* P ixeIs °f displayed image 14 ap- 
pear as an average of the four independent display pix- 
els. Thus, bnghtness or intensity of each pixel of dis- 
played image 14 includes the average brightness or in- 
tensity of four independent display pixels. 
10087] In one embodiment, as described above and 
illustrated In Figure 14E, four image sub-frames 30 1 are 
created such that displayed image portions 141, 
1 42,143, and 1 44 are shifted in a four-position "box" pat- 
tern to produce displayed image 14. As such, in one em- 
bedment, image data 16 of second image sub-frame 
302* is offset a horizontal distance from Image data 1 6 
of first image sub-frame 301 \ image data 1 6 of third im- 
age sub-frame 303* is offset a vertical distance from im- 
age data 1 6 of second image sub-frame 302', and Image 
data 16 of fourth image sub-frame 304' Is offset a hori- 
zontal distance from image data 1 8 of third image sub- 
frame 303' such that the horizontal distance and the ver- 
tical distance are both n pixels. Thus, image sub-frames 
30' are shifted between respective positions A, 8, C, and 
D. In one embodiment n Is a whole number, in another 
embodiment, n is greater than one and Is a non-integer. 
[0088] In one embodiment as illustrated in Figure 16, 
four image sub-frames 30" are created such that dis- 
played image portions 141 , 142, 143, and 144 are shift- 
ed in a four-position "bow-tie" pattern.- As such, in one 
embodiment, image data 1 6 of second image sub-frame 
302 1 is offset a horizontal distance and a vertical dis- 
tance from image data 16 of first image sub-frame 301 \ 
image data 1 6 of third image sub-frame 303' is offset a 
vertical distance from Image data 16 of second image 
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sub-frame 302\ and Image data 1 6 of fourth image sub- 
frame 304' Is offset a horizontal distance and a vertical 
distance from image data 1 6 of third image sub-frame 
303' such that the horizontal distance and the vertical 

9 distance are both n pixels. Thus, image sub-frames 30' 
are shifted between respective positions A, B, C, and D. 
In one embodiment, n is a whole number. In another em- 
bodiment, n is greater than one and is a non-Integer. 
[0039] In one embodiment, as illustrated in Figure 1 7, 

10 four image sub-frames 30' are created such that dis- 
played image portions 141 , 142, 143. and 14* are shift- 
ed in a four-position "scramble" pattern. As such, in one 
embodiment Image data 1 6 of second image sub-frame 
302* is offset a horizontal distance and a vertical dis- 

13 tance from image data 1 6 of first Image sub-frame 301 \ 
image data 1 6 of third Image sub-frame 303' is offset a 
vertical distance from image data 1 6 of second image 
sub-frame 302', and image data 16 of fourth image sub- 
frame 304' is offset a horizontal distance and a vertical 

20 distance from image data 1 6 of third image sub-frame 
303' such that the horizontal distances and the vertical 
distances include n pixels and m pixels, respectively. 
Thus, image sub-frames 30' are shifted between re- 
spective positions A, B, C, and D, In one embodiment, 

25 n and m are whole numbers and are not equal to each 
other. In another embodiment, n and mare each greater 
than one and are non-integers, 
mogrj] In one embodiment a first image frame 28 is 
created for a first image and a second image frame 28' 

so is created for a second imago. In adaption, in one em- 
bodiment, a first set of image sub-frames 30' are defined 
for first image frame 28 and a second set of image sub- 
frames 30" are definedfor second imageframe 28'. The 
first set of image sub-frames 30' and the second set of 

as image sub-frames 30" each include one or more sub- 
frames for the respective image frame. As such, a first 
set of displayed image portions for first image frame 28 
are produced with the first set of image sub-frames SO* 
and a second set of displayed Image portionsfbrsecond 

40 image frame 28' are produced with the second set of 
image sub-frames 30". In one embodiment first Image 
frame 28 and second image frame 28' are created for 
one image. As such, multiple Image frames are created 
for the image from image data 16. 

4* [0091} In one embodiment, as illustrated in Figure 1 S. 
the first set of displayed Image portions for first image 
frame28 are shifted in afiret pattern and the second set 
of displayed image portions for second image frame 29* 
are shifted in a second pattern. In one embodiment, the 

so second pattern is offset from the first pattern. In addition, 
the second pattern may be the same or different from 
the first pattern. As such, a first set of display pixels are 
used to display the first set of image sub-frames 30' and 
a second set of display pixels are used to display the 

ss second set of image sub-frames 30". 

[0092] In one embodiment, image data 1 6 of second 
image sub-frame 302* is offset a horizontal distance 
from image data 16 of first image sub-frame 30V for 
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each set of image sub-frames 30' and 30\ image data 
16 of third image sub-frame 303' id offset a vertical dis- 
tance from imago data 16 of second image eub-frame 
302* for each set of image sub-frames'SO 1 and 30% im- 
ago data 16 of fourth image sub-frame 304* is offset a 
horizontal distance from Image data .16 of third image 
sub-frame 303' for each set of Image sub-frames 30' and 
2CT suchthatthe horizontal distance and the vertical dis- 
tance are both n pixels. Thus, Image sub-frames SO 1 are 
shifted between respective positions A, B, C, and D, and 
image sub-frames 30" are shifted between respective 
positions E, R G, and H. In one embodiment, n is a whole 
number. In another embodiment, n is greater than one 
and Is a non-integer. 

[0093] In one embodiment, as illustrated in Figure 1 9, 
two image sub-frames 30' are created such that dis- 
played Image portions 141 and 142 are shifted in a two- 
position horizontal pattern. As such, image data 16 of 
second image sub-frame 302* is offset a horizontal dis- 
tance from image data 1 6 of first image sub-frame 301 \ 
where the horizontal distance includes n pixels. Thus, 
image sub-frames 30* are shifted between respective 
positions A and B. In one embodiment n is a whole 
number In another embodiment, n is greater than one 
and is a non-integer. 

[0094] In one embodiment, as illustrated in Figure 20, 
two image sub-frames 30' are created such that dis- 
played image portions 141 and 142 am shifted in a two- 
position vertical pattern. As such, image data 1 6 of sec- 
ond image sub-frame 302* is offset a vertical distance 
from image data 1 6 of first image sub-frame 301 \ where 
the vertical distance Includes n pixels. Thus, image sub- 
frames 30 1 are shifted between respective positions A 
and B. In one embodiment, n is a whole number. In an- 
other embodiment, n b greater than one and is a non- 
integer. 

[0095] In one embodiment, as Illustrated in Figure 21 , 
two image sub-frames 30' are created such that dis- 
played image portions 1 41 and 1 42 are shifted in a two- 
position diagonal pattern. As such, Image data 16 of 
second image sub-frame 302' Is offset a horizontal dis- 
tance and a vertical distance from image data 1 6 of first 
Image sub-frame 30V, where the horizontal distance 
and vertical distance indude n pixels and m pixels, re- 
spectively. Thus, image sub-frames 30' are shifted be- 
tween respective positions A and B. In one embodiment, 
n and m are whole numbers and are equal to each other. 
In another embodiment, n and m are whole numbers 
and are not equal to each other. In another embodiment, 
n and m are each greaterthan one and are non-integers. 
[0096] Figures 22 and 23 illustrate enlarged image 
portions produced from the same Image data without 
and with, respectively, image processing by Image dis- 
play system 10. More specif tealry, Figure 22 illustrates 
an enlarged image portion produced without processing 
by image display system 10. As illustrated in Figure 22, 
enlarged image portion 80 appears pixelated with indi- 
vidual pbcete being readily visible. In addition, enlarged 
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Image portion 80 is of a lower resolution. 
[0097] As illustrated in Figure 22, two pixels of en- 
larged Image portion 60 are produced with defective dis- 
play pixels. More specifically, one pixel 801 of enlarged 

s image portion 60 appears white as the display pixel cor- 
responding to pixel 801 exhibits only an "ON* position. 
In addition, another pixel 802 of enlarged image portion 
80 appears black as the display pixel corresponding to 
pixel 802 exhibits only an - OFP position. The affect of 

10 these defective display pixels Is readily visible in en- 
larged image portion 60, Figure 23, however, illustrates 
an enlarged image portion 82 produced with processing 
by image display system 10 including resolution en- 
hancement and error hiding, as described above. As il- 

15 lustrated in Figure 23, enlarged Image portion 82 does 
not appear pixelated compared to enlarged image por- 
tion 80 of Figure 22. Thus, image quality of enlarged im- 
age portion 82 is enhanced with image display system 
10. More specifically, resolution of enlarged image por- 

20 tion 82 Is improved or increased compared to enlarged 
Image portion 80. 

[0098] In one illustrative embodiment, enlarged im- 
age portion 82 is produced by four-position processing 
Including a first sub-frame, a second sub-frame, a third 

2$ sub-frame, and a fourth sub-frame, as described above. 
Thus, four times the amount of pixel data ie used to cre- 
ate enlarged Image portion 82 as compared to the 
amount of pixel data used to create enlarged image por- 
tion 80. Accordingly, with four-position processing, the 

so resolution of enlarged image portion 82 is Increased rel- 
ative to the resolution of enlarged Image portion 90 by 
aractoroftwoorthe square root of four. In addition, the 
affect of the defective display pixels is diffused. More 
specifically, the affect of the display pixel which exhibits 

& only the "ON" position is distributed or diffused over a 
region 821 of enlarged image portion 82 including four 
pixels and the affect of the display pixel which exhibits 
only the "OFF" position is distributed or diffused over a 
region 822 of enlarged image portion 82 including four 

ao pixels. As such, the defective display pixels are not as 
noticeable in enlarged Image portion 82 as compared to 
enlarged image portion 80. 

[0099] In one ernbodirnent, to increase the resolution 
of enlarged image portion 82 and diffuse the affect of 
45 the defective display pixels in enlarged image portion 
B2, thesub-frames used to produce enlarged image por- 
tion 82 aie offset at least n pixels from each other, 
wherein n is greaterthan one and is a non-integer. Thus, 
the horizontal distance and/or the vertical distance be- 
so tween thesub-frames includes at least n pixels, wherein 
n Is greaterthan one and is a non-integer. 
[0100] in one embodiment, image display system 10 
compensates for a defective display pixel or pixels of 
display device 2$. More specifically, a defective display 
55 pixel or pixels of display device 26 is identified and Im- 
age data 1 6 corresponding to the location of the defec- 
tive display pixel or pixels In the displayed image is ad- 
justed. 



10 



PAGE 17/122 * RCVD AT 6/27/2006 4:02:55 PM [Eastern Daylight Time] * SVR:USPTO-EFXRF-3fO * DNIS:2738300 * CSID:6508575487 ^ DURATION <mm-ss):36-18 



JUN. 21 2006 1 2:51 PM 



HP LEGAL 



NO. 460 P. 18 



19 EP13 

£0101] For example, as illustrated In Figure 15, dis- 
play position bii includes contribution from a defective 
d^play pixel- More specifically, pixel VI of displayed im- 
age portion 1 41 is created with a defective display pixel- 
Display position bii. however, also includes contribu- 
tions from Are© other pixels including pixel VI of dis- 
played image portion 142, pixel Vi of displayed image 
portion 1 43, and pixel VI of displayed image portion 144. 
Accordingly, display position bii is represented by 
D A +VI B 4-Vltf*VI D . 

[0i02] As illustrated in Figure 13A. pixel VI of dis- 
played Image portion 141 is produced by the display pix- 
el in location C3. Thus, with the display pixel in location 
C3 Identified as a defective display pixel, image data for 
other pixels of display position bii is adjusted to compe n- 
sate for the defective display pixel. More specifically, in> 
age data for pixel VI of displayed Image portion 142, im- 
age data for pixel VI Of displayed image portion 143, 
and/or image data for pfrel VI of displayed image portion 
144 is adjusted to compensate for pixel VI of displayed 
image portion 141. 

[0103] As illustrated in Figures 13B, 13C, and 13D, 
respectively, pixel VI of displayed image portion 142 is 
produced by the display pixel In location C2 V pixel VI of 
displayed image portion 143 is produced by the display 
pixel In location B2, and pixel VI of displayed image por- 
tion 1 44 is produced by the display pixel in location B3, 
Thus, neither pixel VI of displayed image portion 142. 
pixel VI of displayed image portion 143. nor pixel VI of 
displayed image portion 1 44 is affected by the defective 
display pixel in location C3. 

[01 04] In on e embodiment, an intensity of image data 
1 6 corresponding to the location of the defective display 
pixel or pixels in the displayed Image is increased and/ 
or decreased to compensate for the defective display 
pixel or pixels of display device 26. As such, the affect 
of the defective display pixel or pixels in the displayed 
image is reduced. The defective display pixel or pixels 
of display device26 may be identified by user input, self- 
diagnostic input or sensing by display device 26, an ex- 
ternal data source, and/or information stored in display 
device 26. In one embodiment, presence of a defective 
display pixel or pixels of display device 26 is communi- 
cated with image processing unit 24, as illustrated in Fig- 
ure 1. 

[0105J Although specific embodiments have been il- 
lustrated and described herein for purposes of descrip- 
tion of the preferred embodiment, it will be appreciated 
by those of ordinary skill in the art that a wide variety of 
alternate and/or equivalent implementations calculated 
to achieve the same purposes may be substituted for 
the specific embodiments shown and described without 
departing from the scope of the present invention. 
Those with skill in the chemical, mechanical, electro- 
mechanical, electrical, and computer art3 will readily ap- 
preciate that the present invention may be Implemented 
in a very wide variety of embodiments. This application 
is intended to cover any adaptations or variations of the 
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preferred embodiments discussed herein. Therefore, ft 
is manifestly intended that this invention be limited only 
by the claims and the equivalents thereof. 

Claims 

1 . A method of displaying an image (12) with a display 
device (26) including a plurality of display pixels 
10 (70), the method comprising: 

receiving image data (16)forthe image, the im- 
age data including individual pixels (16) of the 
image; 

15 buffering the image data and creating a frame 

(2B) of the image, the frame of the image in- 
cluding a plurality of columns and a plurality of 
rows of the pixels of the Image; 
defining a first sub-frame (301) and at least a 

so second sub-frame (302) fortne frame of the im- 

age, image data of the second sub-frame being 
offset from image data of the first sub-frame by 
an offset distance of at least one pixel; and 
displaying the first sub-frame with a first plural- 

2s ity of the display pixels and displaying the see- 

on d sub-frame with a second plurality of the dis- 
play pixels offset from the first plurality of the 
display pixels by the offset distance. 

so 2. The method of claim 1 , wherein displaying the first 
sub-frame includes producing a first displayed im- 
age portion (141) and displaying the second sub- 
frame includes producing a second displayed im- 
age portion (142), further comprising: 

35 

displaying the first displayed image portion in a 
display position; and 

displaying the second displayed image portion 
in the display position, including displacing the 
40 second displayed image portion by the offset 

distance. 

3. The method of clafrn 1 , wherein at least one of the 
display pixels of the display device Is a defective 

45 display pixel (72). wherein displaying the first sub- 
frame with the first plurality of the display pixels and 
displaying the second sub-frame with the second 
plurality of the display pixels Includes diffusing an 
affect of the defective display pixel over the image. 

so 

4. The method of claim 1 , wherein at least one of the 
display pixels of the display device is a defective 
display pixel (72), wherein displaying the first sub- 
frame with the first plurality of the display pixels and 

53 displaying the second sub-frame with the second 
plurality of the display pixels includes displaying a 
pixel of the first sub-frame and a pixel of the second 
sub-frame with the defective display pixel and dif- 
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fusing an affect of the- defective display pixel over 
the image. 

5. Tha method of claim 1 , wherein image data of the 
second sub-frame Is offset from image data of the 
first sub-frame by n pixels, wherein n is a whole 
number. 

6. The method of claim 1 , wherein image data of the 
second sub-frame is offset from image data of the 
first sub-frame by n pixels, wherein n is greater than 
one and is a non-integer. 

7. The method of claim 1 , wherein at least one of the 
display pixels of the display device is a defective 
display pixel (72), and further comprising: 

compensating for the defective display pixel, in- 
cluding adjusting image data of at least one of 
the first sub-frame and tha second sub-frame 
corresponding to a location of the defective dis- 
play pixel in the (mage. 

6. The method of claim t , further comprising: 

spatially and temporally displaying thefirst sub- 
frame in a first position and the second sub- 
frame in a second position relative to the first 
position. 

9. A system for displaying an image (1 2) , the system 
comprising: 

a buffer (22) adapted to receive Image data for 
the image and buffer the image data to create 
a frame (28) of the image, the image data in- 
cluding individual pixels (1 8) of the image and 
the frame of the image including a plurality of 
columns and a plurality of rows of the pixels of 
the Image; 

an image processing unit (24) adapted to define 
a first sub-frame (301) and at least a second 
sub-frame (302) for the frame ofthe Image, the 
first sub-frame and the second sub-frame each 
including a plurality of pixels and image data of 
the second sub-frame being offset from Image 
data ofthe first sub-frame by an offset distance 
of at least one pixel; and 
a display device (26) including a plurality of dis- 
play pixels (70) and adapted to temporally dis- 
play the first sub-frame with a first plurality of 
the display pixels and display the second sub- 
frame with a second plurality of the display pix- 
els offset from the first plurality of the display 
pixels by the offset distance. 

10. The system of claim 9, wherein the display device 
is adapted to produce a first displayed image por- 



tion (141) with the first sub-frame and produce a 
second displayed image portion (142) with the sec- 
ond sub-f rame> wherein the display device is adapt- 
ed to display the first displayed image portion in a 
5 display position and displace the second displayed 
image portion by the offset distance to display the 
second displayed image portion in the display posi- 
tion. 

10 11 . The system of claim 9. wherein at least on© of the 
display pixels of the display device is a defective 
display pixel (72), wherein the display device is 
adapted to diffuse an affect of the defective display 
pixel over the image. 

1$ ■ s 

12; The system of claim 9, wherein at least one ofthe 
display pixels of the display device is a defective 
display pixel (72), wherein the display device Is 
adapted to display a pixel ofthe first sub-frame and 

20 a pixel of the second sub-frame with the defective 
display pixel end diffuse an affect of the defective 
display pixel over the image. 

13. The system of claim 9, wherein image data of the 
29 second sub-frame is offset from image data of the 

first sub-frame by n pixels, wherein n is a whole 
number. 

14. The system of claim 9, wherein image data of the 
so second sub-f rame Is offset from image data of the 

first sub^frame by n pixels, wherein n is greaterthan 
one and Is a non-integer 

15. The system of claim 9, wherein at least one of the 
$$ display pixels of the display device is a defective 

display pixel (72), and wherein the image process- 
ing unit Is adapted to adjust image data of at least 
one of the first sub-frame and the second sub-frame 
corresponding to a location ofthe defective display 
40 pixel in the Image to compensate for the defective 
display pixel. 

16. The system of claim 9. wherein the display device 
is adapted to temporally display the first sub-frame 

45 in aflrst position and th© second sub-frame In a sec- 
ond position spatially offset from the first position. 

17. Amethod of displaying an image (12) with a display 
device (26) including a plurality of display pixels 

so (70), the method comprising: 

receiving image data (16)forthe image, the im- 
age data including Individual pixels (t8) of the 
image; 

55 creating a first frame (28) and a second frame 

(28*) of the image, the first frame and the sec- 
ond frame each including a plurality of columns 
and a plurality of rows ofthe pixels ofthe image; 
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and 

displaying the firstf rame with a first plurality of 
the display pixels and displaying the second 
frame with a second plurality of the display pix- 
els offset from the first plurality of the display 5 
pixels by at least one pixel. 

18. A method for displaying image data {1 6) with a dis- 
play device (26) having an array of pixels (70), the 
method comprising; 10 

creating multiple frames (28, 28') from the im- 
age data; 

positioning each of the multiple frames on the 
display device, including offsetting each of the 15 
mufopls frames from one another by at least 
one pixel in at least one direction; and 
displaying each of the multiple frames with the 
display device, including aligning the multiple 
frames with each otherto display the imageda- 20 
ta. 

19. A display device (26) for displaying an Image (12) 
having a first array of pixels (1 8), the display device 
comprising: & 

a light modulator (90) having asecond array of 
pixels (70); and 

an image shifter (38) adapted to temporal ty and 
spatially adjustthefiret array of pixels such that w 
each pixel of the Image is formed with more 
than one pixel of the second array of pixels. 



40 



45 



so 



55 
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(WITH TWO-POSITION PROCESSING) 



FIG. 5 
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(WITH FOUR-POSITION PROCESSING) 



FIG.9 
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FIG. 22 




(WITH FOUR-POSITION PROCESSING) 

FIG. 23 
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